All Questions
Tagged with hyperparameterpython
17 questions
0votes
1answer
167views
Optimal combination of variables to minimise output
To be honest I'm not 100% sure how much this is purely a coding issue or a data science issue, but I'll take my chances. I've developed a matrix which is a mixture of various hyperparameters, the ...
1vote
0answers
87views
How to compare hyperparameter tuning in R and Python
I tried random forest in both R (Caret) and Python (Scikit-learn), but the results differ drastically. Pearson correlation between predicted value and actual value was 0.2 in python whereas 0.8 in R. ...
1vote
1answer
98views
Tuning SVM C parameter
I would like to ask for help regarding my model. I have a dataset of preprocessed images and I performed a binary classification with SVM on Python. I tuned the value of the c parameter from 0.001 to ...
9votes
2answers
5kviews
XGBoost and Random Forest: ntrees vs. number of boosting rounds vs. n_estimators
So I understand the main difference between Random Forests and GB Methods. Random Forests grow parallel trees and GB Methods grow one tree for each iteration. However, I am confused on the vocab used ...
2votes
0answers
36views
Parameter optimization and selection in dynamic neural networks
I have used a Bayesian optimization to tune machine learning parameters. The optimized parameters are "Hidden layer size" and "...
- 2,499
0votes
1answer
2kviews
How to choose the model parameters (RandomizedSearchCV, .GridSearchCV) or manually
Faced with the task of selecting parameters for the lightgbm model, the question accordingly arises, what is the best way to select them? I used the RandomizedSearchCV method, within 10 hours the ...
- 121
1vote
1answer
931views
KNN RandomizedSearchCV typerror
While trying to study a binary classification problem with KNN and trying to tune the parameters of the model I'm getting a typerror that I quite don't understand. Is a parameter missing or something? ...
- 175
1vote
1answer
2kviews
What is the possible range of SVR parameters range?
I'm working on a regression problem. While tunning the Parameters of SVR I got the following values c=100, gamma= 10 and epsilon =100. For which I got 95 percent r-square. My question is what is the ...
1vote
0answers
153views
std::bad_alloc with densenet and hyperas
I am filing this issue after being stagnated here for couple of weeks. I am using hyperas to find the hyperparameters for my network, Densenet. My issue here is that my evaluation always fails with ...
- 600
4votes
2answers
243views
Benefits of using Deep Learning-specific hyperparameter optimization tools vs. sklearn?
There are quite a few library for hyperparameter optimization that are specific to Keras or other Deep Learning libraries, like Hyperas or Talos. My question is, what's the main benefit of using ...
- 161
4votes
1answer
2kviews
What does the "dual" parameter in sklearn.svm.LinearSVC and sklearn.svm.LinearSVR do?
While I am more or less familiar with the idea of the SVM, I do not understand the meaning of the dual parameter, which is described in the documentation as: ...
1vote
1answer
2kviews
Is there any alternative to L-BFGS-B algorithm for hyperparameter optimization in Scikit learn?
The Gaussian process regression can be computed in scikit learn using an object of class GaussianProcessRegressor as: ...
- 103
6votes
2answers
38kviews
How to implement Python's MLPClassifier with gridsearchCV?
I am trying to implement Python's MLPClassifier with 10 fold cross-validation using gridsearchCV function. Here is a chunk of my code: ...
- 63
1vote
1answer
2kviews
Can't reproduce results from GridSearchCV?
I am trying to find optimized n_neighbors value for KnearestClassifier using GridSearchCV. I am able to get optimized parameters but when I enter those in my classifier results don't match with ...
- 13
7votes
1answer
6kviews
Overfitting for minority class after SMOTE w/ random forests
I used SMOTE to make a predictive model, with class 1 having 1800 samples and 35000+ of class 0 samples. Hence, as per SMOTE, synthetic samples were created and the random forest was trained. However,...
- 423
